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ABSTRACT / , . ' - ' ^ ^ 

* ' Confined to^ e-yisting mone.lfary ^and human i;esources, 
.theTlavy's Postgraduate Selection Board is "responsible for selecting 
officers for graduate^ducation 'who* will boi:h perforin well, and 
'develop skills 4,pp>icatrle ^^o later Navy bilL^ts J* Although different; 
la^ethodig have been/enp]ro.ted' tor thi^ ' select^-on process, mostr^ decisions 
h^v^e been based 6n. officer fitness reports and tfriqr . academic 
recotds. Data from' the^Gradukt'e Retfgr^ Exam fQRE^v' St rong Vocational 
I^^efest Blaiik (SVIB) , and a bio=^raphic ^atar form were\use3^ in 
attempts to predict "Naval Postgraduate School grade averages. .in four 
separate curricula: Operations Reseafch/Systenfs Analy-sis', 
Aeronautical Engineer in'g. Communications Management, arid"' Ma'nagement • 
Results indicate* that academic aptitude^and biographic data coUld ]d§ 
'U^sed for s^ection to thB ^aval ' Postgraduate School* Implementation 
vouia "require the availability of biograpiiical data and GRE scores 
fof all candidates. The oosts .of developing .these data would seem 
small when compared to <1> th'e time saving that could accrue by 
^streamlining the postgraduate sel^ctipn process, aad (2) ^the more 
effective* use -of officer/student human ^resources. (BJG) . .\ 
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The UlS. Navy and the other U.S. services spend millions of 
dollars every year on the graduate education of their officers;. In 
recent years, about' 570 U.S. Navy officers 'a year have receive Navy 
funded graduate degrees at the Naval Postgraduate School (Congressional 
Record, 1973, p. 617). ^he Justif igatioQ for thes^ educational Wograms 
has been tliat c^taln Navy officer billets require the* incumbent \o 
have Such ^an education to perform optimally in the job (SECNAVINST 
1520*4A), *^The best payoff to the Navy c6mes , then, when officers aVe 
selected for educational curricula in which thfey peorfonu- well, and i 
which they dev^lot) skills they, wi>h' to appljy In their later Navy bil*5ts. 



Tresent Selection Procedures 



)-0 

o 

. o 



ERIC 



V / The l^avy^'s 'Bureau of Personnel (B^Pers) defives the educationaf 
' quotas for the different curricula by juxtaposing billets' requiting a 
graduate officer with the populations of officers having chat education. 
These educational quotas are .then reviewed in light of existing monetary 
^and manpower constraints. Ultimately, shortfalls ^re published; clas- 
sified by educational area, year group and designator* (e.g. , aviajtor) . 
BuPers -then provides the shortfall data to the Postgraduate Select ian 
Board. The Po^jj^raduate Selection Board is annually formed by guPers^ 
and requires a 'month or more to complete Its work. The Board .*s members 
are banking officers from each Navy designator, and many of them hold 
graduate degrees. The Board's task Is to'^ examine the records of 
officers- who could be selected for graduate education. These records 
include the officer's fitness reports and his prior academic records- 
Occasionally, the officer's scores on- the Graduate Record -Exam (GRE) 
would also be in his recoCjds. Also available to the Postgraduate^ 
Selection Board for most offic-ers are their curricular preferences/ 
Given the officers* f^ecords* and » preferences , and the educational quotas, 
the Postgraduate* ^Sel^ction Board proceeds with the selection of, Navy 
officers for graduate education programs. The FY 75 Board considered 
15,'406 officers and selected only 1,285. In mak^g cheir vevalUa'tion • 



This research was sponsored by the Nav;^ P6rsonn^l Research and 
Development Center, San Diego, CA. ^ * 
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of *dach of the thousands of o^-ficers, prior academic work is s,upposed 
to be weighted A0% and Nayy performance .(as assessed by fitness reports) 
60%. Once the Postgraduate Selection Board has finished its month or' 
more of work, the list of of f icers '^^mes i«& sent to the officer de- 
tailing sec'tion of BuPers. The detailers have the final responsibility 
for assigning officers to graduate* curricula. 



Method 



The invest igat6rs felt that the methods and procedures for ^ 
selecting Navy of-ficers could be made less time and manpower consuming* 
and, pr>3bably, more valid. Consequently, a concurrent validation study 
was designed and conducted, using as subjects U.S. Navy officer/students 



on-board at NFS. 



The Strong Vocationai Interest Blaftk (SVIB) , the GRE and a 
biographic data collectri<m^onD were administered to the groups shown 
in Table I during fiscal year 1974. \ ^ ^ 

. r_ ' , Table I : ) 

Curricul^ and Numbers of Students 



/ 



Curriculum Number of Students 

> 

Ops. Res./Sys. Anal. 80 

Computer Systems Mgt. 48\^ ^ 

Computer Science ' - ^ . 24 

Aero Eng. * ^ 103 

Communications Mgt. . ' * 42 

Sys. Acq. Management 52 

.Management , 130 

TOTAL A 79 



• NFS grade averages (TQFRs) were also gathered from these 9fficer/ 
students. 

*' • ' 

, Frelim^inary Analyses 

As the grade average i^as to be used a^ the criterion measure in 
this research, it was neces&ary to- understand its behavior. The first 
question addressed cbncerned the accuracy of self-^reported TQFRi. 

The NFS academic transcripts of 55 Managemeivt students were 
gathered and the computed '^XQFRs compared wi*th the s*elf-reported NFS 

♦ 
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TQPRs.' The correlation between th^ reported and actual TQPRs was .99, 
^nd the means were 3.37 and 3. 34, (on a scale where A = 4.00), respec- 
tively (Welch, 1974, p. 19). A similar analysis was donfeVith the 
records of the 42 U.S.N, students in Communications Management.' In all 
42 cases, the actual and self-reported NPS TQPRs were identical. 
Obviously, the investigators could use self-reported NPS TQ?K as cri- 
terion data and avoid retriev.ing' each officer's transcript 

A second stud^ of TQPRs investigated the longyf^odinal stability 
of individuals* TQPRs'. This investigation' was impa^ant for two reasons. 
First, if grades are quite unstable over time, th^ they might be un- 
predictable, or-different variables might be required to predict TQPRs 
Iji different quarters of an academic curriculum. The second reason for 
' doing the grad^ tabi lity study arose from the* relatively small sample 
sizes in the diff5|rent curricula. The s'^t of students in a particular 
curriculum consisti^d of two or ^ore subsets of students th^t had be^n 
in the curricu-lura different lengths of time. If TQPRs were statle ov^ 
time, then TQPR dat4 from students who had finished only a few quarters 
could b*e considered ks indicative of what- their TQPR would be upon 
comple'ting their curriculum.' In oth^r^words, if TQPEls were quice stable, 
the data from the dif-ferent student subsets in a curriculum could pos- 
9'ibiy be agg-regated. Table II is rfep.resentative of the patterns of 
correlations found in the curricula investigated. The correlations are 
high—even given .that ^ they are part-whole correlations. In summary, , 
the. correlations indicate that TQPRs after two, or at most, three 
quarters are very' predictive of TQPRs after six cjuarters. 
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Table II 



Correlations Among TQPRs After Completion of 
Different Numbers of Quarters of the Ops'. Res./Sys. Anal. 

Longitudinal Dat^ (N =^5 U.S.N. Officezs)'^ 



Curriculum: 



Quarters Completed 





1 


2 


3 


4 


5 






1 1.00 


.95- 


.92 


.92 


.90 


■ .89 




■ 2 


1.00 


.98 


.97 


.96 


' .95 


Quarters 


3 




1.00 


.99 


.98 


' .97 


Completed 


4 . 






i.OO 


.99 


.99 




5 








l.OCf 


'1 . 00 




6 










1.00 




■''Source : 


Welch 


, 1974, 


p. 21 







Further^ analyses of the TQPR data uncovered two other facts: 
First, the variance among inputs (an input being a group of students 
entering the curriculxim at the same time) on TQPR is much smaller than 
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the TQPR variance within an input in a curriculum; second, an input 
group 's' average TQPR tends to sneak upwards as their time spent in the 
curriculum increases. 

« 

Because of the results of the analyses conducted on NPS TQPRs 
the decision vfas made to standard score the TQPRs for e^ch input into 
each* curriculum. Thus, the standardization process yielded equal TQPR 
^e'ans and standard deviations for all of the inputs and curricula. 



,TQPR Prediction Study Results 



Data from the Graduate Record Exam (GRE) , Strong Vocational 
Interest, Blank (SVfB) , and m biographic data form were used in attempts 
to predict TQPRs in' foyr separate curricula: ^X)ps . . Res . /Sys . Anal., 
Aero Eng., Commuhic^tiona Mgt., and Management. Multiple l^ear re- 
gression was the primary analytical technique used in the prediction 
studies. Within (^ch curriculum, developmental and cross-validation 
gro^ups wene ranM^ly formed. Prediction equations generated using the 
data from a dev^opmental group, 'and yielding a statistically signifi- 
cant multipJLe OT^relation coefficient in the relevant cross-validation 
group, will b^reported in the following paragraphs. 

Aeronau ticaA/Engineering 
/ 

Seyeral useful predictiori equations were developed for this 



' curriciilpin;, the equation presented here for predicting standardized 
TQEft is the most face valid one and yielded a multiple correlation of 
in the faross-validation group of 30 students (Sofge, 1974, p. 52). 



TQPRZ = - A.20 -fl.635(VAR001) + .691(VAR004) 
+ .0P18A(GREV) + . 00322 (GREQ) 
+ .00568CINDEX) - 1.02(BQPR) 



■4^ 



Where: TQPRZ. = Standardized TQPR 

VAROOl = Naval Academy Graduate: yes = 1; no = 0 
VAkOOA = Lt. or below: yes = 1; no = 0 
GREV = GRE Verbal Score 
GREQ = GRE Quantitative Score 
* BQPR = Self-reported- baccalaureate grade average 
INDEX ^ BQPR-x.Qual (Qual is an estimate of the 

(Quality of the individual's baccalaureate 



institution from Hoyt/s data.) ^ 
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TQPRZ = - 3,632 '+ 1.746(4GPA) + 1. A5A(VAR6o1) 

- .65A6(VAR002) -..606(3GPA) 

Where: TQPRZ = Standardized TQPR ' * ' ■ 

AGPA =. Calculated grade average in the individual's 

fourth undergraduate year 
VAROOl = 1 if the individual had an undergraduate 

major in engineering 
VAROOl = 0 if the individual was not an undergraduate 

engineering major • 
VAR002 = 1 if the officer had graduated from the 

Nava 1 , Academy 
VAR002 = 0 if the officer had not graduated from 

the Naval Academy 
3GPA = The individual's grade average in tiis chird 

undergraduate year 



The equation yielded a multiple correlation coefficient of ,63 
in the cross-validation group (N = 12) • 



Discussion 



The results shown above clearly indicate that ^academic aptitude 
and biographic data could be used to select U.S. Navy officers for 
attendance at the Naval Postgraduate School, Other analyses, not re- 
ported here, have shown the SVIB to be useful also in predicting TQPR* 
The results reported here- seem impressive when it is considered that 
the students in the study had already been through the Postgraduate 
Selection Boa^d screening — a process which should have led to restriction 
of range on a number of variables, with a consequent lowering of the , 
multiple correlation ^coefficien^ts. 

For the Navy's Bureau of Personnel to use the findings reported 
here, biograpljic data and GRE scores would have to be available for the 
officers being' considered for graduate education. The costs of devel- 
oping these data would seem to be small when compared to: (1) the 
time saving that could accrue by streamlining the Postgraduate selection ^ 
process, and (2) the mo/e effective use of the officer/student human 
resource that could be achieve^! through more valid selection methods. 
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A rather simple prediction equatiqii was found to be useful in • 
predicting TQPRs in the Management curriculum. 

— • 

TQPRZ = - 3.9A + .0059(GREQ) 
> .6897(VAR001) 

Where: TQPRZ = Statt^ardized TQPR^ 

GREQ = GRE^ Quantitative Score 
VAROOl = r*rf*"chrdnological age ^ 30. 
VAROOl = 0 if chronological age > 30. 



This equation yielded a multiple correlation of .65 in che cross- 
validation sample (N = 20). 



Operations ,Res'earch/Sys tems Analysis 

"The multiple regression analysis conducted with the data from 
this curriculum yielded an equation having in it three predictor 
variables. 

TQPRZ = - 2.3AA5 + . 003-22 (INDEX) 
' + .A067(VAR00i) + . 2668(VAR002) ' ^ ^ 

^ Where: TQPRZ = ^ tandard£?e*d TQPRj. 
— — VAROOl - 1 if the officer speaks* a foreign language •* 
VAROOl = 0 if .fhe_off icer does not speak a foreign. 
S • language ^ 

VAR0Cr2-= 1 if the officer's age is ^ 30. 
VAR002 = 0 if the officer's age is > 30. , 
INDEX = BQPR X Qual (BQPR was self-reported bac- 
- . calaureate grade average. Qual is an 

^ estimate of th^t^ality of the officer's 

. ' baccalaureate institution from Hoyt's 

data.) 



This equation yielded a multiple correlation 
validation 'sample (N - 20). 



Communications Management 

A multiple regression equation using four predictors was developed 
for thj.s curriculum (Cook, 197A) . 



of .45 in the cross- 
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